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Abstract 



We cannot always 
build the future for 
our youth, but we 
can build the youth 
for our future. 

— Franklin D. 

Roosevelt 



T his report summarizes results from three large-scale reviews of research on 
the impact of social and emotional learning (SEL) programs on elementary- 
and middle-school students — that is, programs that seek to promote various 
social and emotional skills. Collectively the three reviews included 317 studies and 
involved 324,303 children. 

SEL programs yielded multiple benefits in each review and were effective in both 
school and after-school settings and for students with and without behavioral and 
emotional problems. They were also effective across the K-8 grade range and for 
racially and ethnically diverse students from urban, rural, and suburban settings. SEL 
programs improved students’ social-emotional skills, attitudes about self and others, 
connection to school, positive social behavior, and academic performance; they also 
reduced students’ conduct problems and emotional distress. Comparing results from 
these reviews to findings obtained in reviews of interventions by other research teams 
suggests that SEL programs are among the most successful youth-development pro- 
grams offered to school-age youth. Furthermore, school staff (e.g., teachers, student 
support staff) carried out SEL programs effectively, indicating that they can be incor- 
porated into routine educational practice. In addition, SEL programming improved 
students’ academic performance by 11 to 17 percentile points across the three re- 
views, indicating that they offer students a practical educational benefit. Given these 
positive findings, we recommend that federal, state, and local policies and practices 
encourage the broad implementation of well-designed, evidence-based SEL programs 
during and after school. 
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Introduction 



T wenty-first century schools serve socio-culturally diverse students with varied 
abilities and motivations for learning (Learning First Alliance, 2001). While 
some students are academically engaged and participate energetically in class 
and extracurricular activities, others are less engaged and achieve poorly (Blum & 
Libbey, 2004). Many students become more disengaged from school as they progress 
from elementary to middle to high school. It is estimated that 40 to 60% of urban, 
suburban, and rural high school students become chronically disengaged from school 
— not counting those who have already dropped out (Klem & Connell, 2004). Ap- 
proximately 30% of high school students participate in or experience multiple high- 
risk behaviors (e.g., substance use, sex, violence, depression, attempted suicide) that 
interfere with school performance and jeopardize their potential for life success (Cen- 
ters for Disease Control and Prevention, 2008; Dryfoos, 1997). Furthermore, large 
percentages of students lack social-emotional competence, believe their teachers do 
not care about them, and disrupt the educational experiences of classmates (Benson, 
Scales, Leffert, & Roehlkepartain, 1999). 

Preparing students for life success requires a broad, balanced education that both 
ensures their mastery of basic academic skills and also prepares them to become 
responsible adults (Association for Supervision and Curriculum Development, 2007). 
It is important for families, schools, and communities to identify and effectively 
implement research-based approaches that promote children’s social, emotional, and 
academic engagement and growth in the early years of school. Research conducted 
during the past few decades indicates that social and emotional learning (SEL) pro- 
gramming for elementary- and middle-school students is a very promising approach 
to reducing problem behaviors, promoting positive adjustment, and enhancing aca- 
demic performance (Diekstra, 2008; Greenberg, Weissberg, O’Brien, Zins, Fredericks, 
Resnik, & Elias, 2003; Wilson, Gottfredson, & Najaka, 2001; Weissberg, Kumpfer, & 
Seligman, 2003; Zins, Weissberg, Wang, & Walberg, 2004). 

The purpose of this report is to summarize the primary findings and implications of 
three large-scale reviews of research evaluating the impact of SEL programs for school 
children in kindergarten through eighth grade. 

1. Universal Review. This review examined the impact of universal school- 
based SEL interventions: that is, interventions that are appropriate for a 
general student body without any identified behavioral or emotional prob- 
lems or difficulties (Durlak, Weissberg, Dymnicki, Taylor, & Schellinger, 

2008). 

2. Indicated Review. This review focused on school-based indicated pro- 
grams: that is, interventions that identify and work with students who are 
displaying early signs of behavioral or emotional problems. 

3. After-School Review. This review evaluated SEL interventions conduct- 
ed in after-school programs, which primarily involved students without 
identified problems (Durlak, Weissberg, & Pachan, in press). 

In other words, we evaluated SEL programs across two different time periods and 
settings (during the school day and after school) and for two different types of student 
populations (those without any identified problems in the Universal and After-School 
Reviews and those with early identified problems in the Indicated Review). Our 
findings were based on 317 studies that involved 324,303 participants. In sum, we ex- 
amined evaluations of programs conducted by many different independent investiga- 
tors in three different research literatures in an attempt to reach general conclusions 
about the impact of SEL interventions. 

What is Social and Emotional Learning? 

Social and emotional learning is the process through which children and adults ac- 
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quire the knowledge, attitudes, and skills to: 

• Recognize and manage their emotions 

• Set and achieve positive goals 

• Demonstrate caring and concern for others 

• Establish and maintain positive relationships 

• Make responsible decisions 

• Handle interpersonal situations effectively 

These critical social-emotional competencies involve skills that enable children to 
calm themselves when angry, initiate friendships and resolve conflicts respectfully, 
make ethical and safe choices, and contribute constructively to their community 
(Collaborative for Academic, Social, and Emotional Learning, 2005; Elias, Zins, Weiss- 
berg, Frey, Greenberg, Haynes, Kessler, Schwab-Stone, & Shriver, 1997; Zins & Elias, 
2006). 

The Collaborative for Academic, Social, and Emotional Learning (CASEL) has 
identified five groups of inter-related core social and emotional competencies that 
SEL programs should address (Collaborative for Academic, Social, and Emotional 
Learning; 2005; Devaney, O’Brien, Keister, Resnik, & Weissberg, 2006): 

• Self-awareness: accurately assessing one’s feelings, interests, values, and strengths; 
maintaining a well-grounded sense of self-confidence; 

• Self-management: regulating one’s emotions to handle stress, controlling impulses, 
and persevering in addressing challenges; expressing emotions appropriately; and 
setting and monitoring progress toward personal and academic goals; 

• Social awareness: being able to take the perspective of and empathize with others; 
recognizing and appreciating individual and group similarities and differences; and 
recognizing and making best use of family, school, and community resources; 

• Relationship sldUs: establishing and maintaining healthy and rewarding relation- 
ships based on cooperation; resisting inappropriate social pressure; preventing, 
managing, and resolving interpersonal conflict; and seeking help when needed; and 

• Responsible deeision malting: making decisions based on consideration of ethical 
standards, safety concerns, appropriate social norms, respect for others, and likely 
consequences of various actions; applying decision-making skills to academic and 
social situations; and contributing to the well-being of one’s school and community. 

Students who appraise themselves and their abilities realistically (self-awareness), 
regulate their feelings and behaviors appropriately (self-management), interpret social 
cues accurately (social awareness), resolve interpersonal conflicts effectively (rela- 
tionship skills), and make good decisions about daily challenges (responsible deci- 
sion making) are headed on a pathway toward success in school and later life. Thus, 
the short-term goals of SEL programming are to promote students’ social-emotional 
skills and positive attitudes, which, in turn, should lead to improved adjustment and 
academic performance as reflected in more positive social behaviors, fewer conduct 
problems, less emotional distress, and better grades and achievement test scores (Col- 
laborative for Academic, Social, and Emotional Learning, 2005; Zins et ah, 2004). 

This report addresses the following research questions: (a) What skills, attitudes, 
behaviors, and academic outcomes do SEL programs achieve for elementary- and 
middle-school (K-8) students? (b) Do SEL program effects endure over time? (c) Are 
SEL programs effective in school and after school and for students with problems 
(Indicated Review) and without problems (Universal and After-School Reviews)? and 
(d) What features are associated with highly effective SEL programs? 
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General Features of Each Review 

For each review, we conducted our analyses using a meta-analytic approach, which 
summarizes in a quantitative fashion the overall impact of interventions across stud- 
ies. Studies eligible for inclusion in these reviews had to emphasize the development 
of one or more social-emotional competencies, target students between the ages of 5 
and 13 (i.e., grades K-8), include a control group, and report information for calculat- 
ing effect sizes (ESs). For each review, we systematically examined published and 
unpublished literature sources to obtain a representative nonbiased sample of investi- 
gations that had appeared by Dec. 31, 2007. 

Tbe Universal Review included 180 school-based studies involving 277,977 stu- 
dents. The most common strategy involved classroom-based programming, which 
usually took the form of a specific curriculum or set of lessons that sought to develop 
social and emotional skills such as problem and feeling identification, goal setting, 
conflict-resolution strategies, and interpersonal problem-solving skills. In addition, 
there were some multi-component programs that supplemented classroom skills 
training with a schoolwide, parent, or community component to reinforce what was 
taught in the classroom (Durlak et al., 2008). 

In the Indicated Review there were 80 studies involving 11,337 students. These 
studies focused on children who showed signs of social, emotional, or behavioral 
problems, but had not been diagnosed with a mental disorder or need for special 
education. More than half (59%) of the programs consisted of a single-intervention 
component such as small-group problem-solving sessions, in which leaders taught 
various social and emotional skills — e.g., recognizing feelings in oneself and others, 
making friends, and handling provocations by others. The remaining studies included 
multi-component programs involving different combinations of individual, group, 
classroom, and parent training supports. 

The After-School Review included 57 studies involving 34,989 students. These af- 
ter-school programs had to be implemented outside of regular school hours during at 
least part of a school year, be supervised or monitored by adults, and have the goal of 
developing one or more personal and social skills. After-school programs that focused 
only on improving academic performance or school attendance, and outdoor-extra- 
curricular, summer camp, or adventure programs such as Outward Bound, were not 
eligible (Durlak et al., in press). 

Main Findings 

Overall, the results indicated strong and consistent support for the value of SEL pro- 
grams. There were six major sets of findings: 

1. Students in SEL programs demonstrated improvement in multiple areas of their 
personal, social, and academic lives. SEL programs fostered positive effects on: 
students’ social-emotional skills; attitudes towards self, school, and others; social 
behaviors; conduct problems; emotional distress; and academic performance. No- 
tably, SEL programming yielded an average gain on achievement test scores of 11 
to 17 percentile points. 

2. SEL interventions were effective in both the school and after-school setting and for 
students with and without presenting problems. They were also successful across 
the K-8 grade range, for schools in urban, suburban, and rural areas, and for ra- 
cially and ethnically diverse student bodies. 

3. Studies that collected data at follow-up indicated these effects remained over time 
— although they were not as strong as the results at post (i.e., immediately after 
the intervention). 

4. Data from the Universal and Indicated Reviews also indicated that SEL programs 
were effective when conducted by school staff, suggesting that these interventions 
can be incorporated into routine educational practice. 
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5. In two of the reviews (Universal and After School), we found that interventions us- 
ing four recommended practices for skill training (we called these SAFE programs) 
were more effective than programs that did not follow these recommendations. 
Each letter in the acronym SAFE refers to a recommended practice for teaching 
skills (Durlak et ah, 2008): 

• Sequenced: Does the program apply a planned set of activities to develop skills 
sequentially in a step-by-step fashion? 

• Active: Does the program use active forms of learning such as role-plays and 
behavioral rehearsal with feedback? 

• Focused: Does the program devote sufficient time exclusively to developing 
social and emotional skills? 

• Explicit: Does the program target specific social and emotional skills? 

6. Placing current findings in the context of previous research offers strong support 
for SEE programming. Comparing the findings in our reviews to results obtained in 
reviews of evidence-based interventions conducted by other researchers suggests 
that SEE programs are among the most successful interventions ever offered to 
school-aged youth. 

In conclusion, our findings demonstrate that SEE programs implemented by school 
staff members (e.g., teachers, student support personnel) improve children’s behav- 
ior, attitudes toward school, and academic achievement. Given these broad positive 
impacts, we recommend that well-designed programs that simultaneously foster stu- 
dents’ social, emotional, and academic growth be widely implemented in schools. 
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Methods 



Study Inclusion Criteria 

Studies eligible for inclusion in these reviews had to be written in English, appear 
by December 2007, emphasize the development of one or more SEE competencies, 
target students between the ages of 5 and 13 (i.e., grades K-8), include a control 
group, and report information sufficient for calculating effect sizes (usually the mean 
outcome of a treatment group and that of a control group post-intervention and the 
standard deviation of each). 

Search methods 

To assure that our sample was as representative as possible, we identified studies for 
inclusion in these reviews through a systematic search of published and unpublished 
reports. Five methods were used: (a) computer searches of multiple databases using 
relevant search terms; (b) searches of the reference lists and bibliographies of previ- 
ous reviews; (c) manual searches of journals with relevant studies from January 1970 
through December 2007; (d) searches of the web sites of organizations that promote 
youth development; and (e) contacting researchers, practitioners, and policy advo- 
cates who presented relevant work at professional conferences. 

Student outeome variables 

To analyze data from tbe reviewed studies, we grouped student outcomes in the same 
six categories across implementation contexts. These outcomes assessed three broad 
areas of student development — (a) social and emotional skills and attitudes (includ- 
ing self-perceptions and attitudes toward school and others); (b) indicators of behav- 
ioral adjustment (e.g., positive social behaviors, problem behaviors, and emotional 
distress); and (c) aspects of school performance (e.g., achievement on standardized 
tests and school grades). Grouping study outcomes into these categories enabled us 
to avoid small cell sizes with insufficient power to identify true differences between 
intervention and control groups. 

Each category included a broad range of related outcomes. In the social and 
emotional skills category these included a variety of personal, social, cognitive, and 
affective skills such as emotional self-awareness, coping with stress, resolving conflict, 
and resisting unwanted peer pressure. Ah skill assessments were based on student, 
teacher, parent, or independent ratings completed in structured or test situations. 
Ratings of daily student behavior were placed in the positive social behavior outcome 
category described below. 

Outcomes in the attitudes toward self, school, and others category included self- 
efficacy, bonding to school, pro-social attitudes, conventional pro-social beliefs about 
violence, social justice, drug use, and in a few after-school studies racial-ethnic iden- 
tity or pride. Ratings in this outcome category were all based on student self-reports. 

Outcomes in the positive social behaviors category included the appropriate 
expression of emotions, positive interactions with others, cooperation, leadership, 
appropriate responses to conflict and peer pressure, and assertiveness in social situ- 
ations, as reflected in daily behavior rather than in hypothetical or test situations, as 
was the case in the social and emotional skills outcome category. 

Outcomes in the conduct problems category included risky, disruptive, and delin- 
quent behavior such as aggression, bullying, noncompliance, rebelliousness, disciplin- 
ary referrals, school suspensions, or delinquent acts based on reports from students, 
teachers, parents, independent raters, or school records. 

Assessments of emotional distress included measures of anxiety, depression, and 
social withdrawal based on reports of students, teachers, and parents. 

Outcome indicators of school performance were based only on standardized 
achievement test scores such as the Iowa Test of Basic Skills and grades in the form of 
overall GPA or grades in specific subjects. 
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Calculation of Effect Size 

The indicator we used to determine program impact on the above student outcomes 
was the standardized mean difference or effect size (ES), usually calculated by sub- 
tracting the control group mean from the intervention group mean at post (or follow- 
up if relevant) and dividing the remainder by the pooled standard deviation of the two 
groups. Typically, we calculated one effect size for each analysis in each study. When- 
ever possible, we adjusted for any previous intervention differences between groups 
on each outcome measure by first calculating a pre ES and then subtracting this from 
the obtained post ES. To calculate a single overall effect size for a study, we averaged 
all of its individual effect sizes. Higher effect sizes reflected a greater positive program 
impact than lower effect sizes. These analyses also used a random effects model: by 
adding an error term to the calculation, the unique features of each program evalua- 
tion could be considered and the findings made more generalizable (Hedges & Olkin, 
1985; Lipsey & Wilson, 2001). We used a two-tailed .05 probability level in determin- 
ing statistical significance, and reported ±.05 confidence intervals throughout the re- 
port. Means are statistically significant when their confidence intervals do not include 
0 . 

Before data were analyzed, outliers falling beyond three standard deviations from 
the mean in either direction were reset using windsorizing, a technique that allows all 
relevant studies and their effects to be retained while eliminating extreme values that 
would distort results (Lipsey & Wilson, 2001). 

Moderating Variables 

In each review we evaluated the possible impact on student outcomes of selected 
moderating variables. In all three we evaluated whether or not a program had imple- 
mentation problems (e.g., incomplete implementation, attendance problems, or 
inadequately trained new teachers) (Durlak & Dupre, 2008). In the universal and 
after-school reviews, we determined whether programs incorporated evidence-based 
training (i.e., SAFE) practices and their impact on student outcomes. Research on 
skills development in youth shows that such practices increase the likelihood of 
learning (Durlak et ah, in press). Finally, in the universal and indicated reviews we 
evaluated the impact on student outcomes of program format or who delivered the 
program, which is discussed more fully below in the results section. 

Quality of implementation has become important in interpreting program effects. 

A lack of significant findings in a partially implemented program, for example, may 
have a different meaning from such a finding in a fully implemented program. The 
former suggests that the program might have had significant effects if it had been 
properly implemented. The latter indicates that the program had little effect in its 
current state. 

We used the acronym SAFE to designate criteria we developed to capture the ap- 
plication of evidence-based practices. These included: (a) a Sequeiiced set of con- 
nected learning activities that teaches social-emotional skills through a coordinated, 
step-by-step approach; (b) the use of Active learning methods such as role-play or 
behavioral rehearsal with feedback; (c) the inclusion of at least one program compo- 
nent that Focused specifically on the development of social-emotional skills through 
devoting sufficient instructional time to it on a regular basis; and (d) Explicit teaching 
of clearly identified skills with clear and specific learning objectives, as distinguished 
from a program goal on general skill enhancement. 

Methodologieal Variables 

To increase the credibility of our findings, we also examined the possible effects of 
three primary methodological variables to determine if they could account for any 
significant differences found between treatment and control groups. These included 
randomization to treatment or control conditions, problems with attrition, and the 
reliability and validity of outcome measures. Randomization compares the effects of 
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studies that used a randomized control design, where participants were randomly 
assigned to experimental and control conditions, with studies that used a quasi-ex- 
perimental design. In the latter, researchers compared participants from experimental 
sites with participants from comparison sites that were matched on key demographic 
characteristics, such as race-ethnicity and socioeconomic status. 

Problems with attrition, which refers to the loss of data from either treatment or 
control subjects due to subject dropout, can distort treatment effects. We coded attri- 
tion yes/no, yes when it was above 30% or when it was between 11-30% and study au- 
thors failed to check for differential attrition across conditions to determine whether 
continuers and dropouts had equivalent ratings on key outcome variables. 

The third methodological variable we considered was the reliability and validity of 
outcome measures. The reliability of an outcome measure was considered acceptable 
if its alpha coefficient was >.70 or the kappa assessment of inter-judge agreement was 
a. 60. A measure was considered valid if authors cited data on its construct, concur- 
rent, or predictive validity. Analyses of these methodological variables (randomiza- 
tion, attrition, reliability, and validity) indicated little outcome bias, meaning that 
none of these variables influenced outcome effects. 

Coding 

A coding system available from the third author was developed to record information 
on many characteristics of the studies reviewed. We estimated reliability of the cod- 
ing process by having pairs of students independently code a random sample of about 
25% of the studies on most variables. Mean kappas for this process were 0.69, and 
rater agreement on continuous variables was consistently above 0.90. We resolved 
coding disagreements among raters through discussion. 
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Results 



W e describe our results for each review separately, starting with the uni- 
versal, then moving on to the indicated and after-school reviews. Within 
each review, we first describe characteristics of the included programs and 
participant populations studied and then describe significant findings across student 
outcome categories. Where relevant, we report the effects of implementation (univer- 
sal), use of evidence-based (SAFE) training practices (universal and after school), or 
factors such as presenting student problems (indicated), program components and 
program deliverers (universal and indicated) on outcomes. 

Universal Review 

Table 1 summarizes characteristics of 180 studies of programs with outcome data 
at post-intervention that were included in the universal review. Nearly 80% of these 
studies appeared since 1990 and most (79%) were in the form of published articles or 
books. Sixty-four percent of the studies evaluated programs that served elementary 
students in grades K-5. A large percentage of studies did not report on the racial-eth- 
nic (29%) or socio-economic background (26%) of program participants. While this 
failure to report participants’ race-ethnicity and socio-economic background did not 
allow us to determine the differential effects of these programs with different student 
groups, it is clear from the data that the studied programs served a very diverse stu- 
dent population in urban, suburban, and rural areas (see Table 1). Lack of follow-up 
data measured after the conclusion of the intervention did not allow us to determine 
the enduring effects of programs. 

More than half of the programs studied were implemented by classroom teachers. 
They involved whole classes of students (i.e., not students who had volunteered to 
participate) with no identified adjustment or learning problems. Universal programs 
had to last at least 8 sessions. The most common program duration (31%) was from 
one semester to an entire school year with a mean of 45 sessions. More than three- 
quarters of studied curricula were rated as meeting all four SAFE criteria for evi- 
dence-based practices. In terms of methodological features, almost half (45%) used 
randomized designs and most (71%) reported no problems with attrition. Seventy-six 
percent of outcome measures were of acceptable reliability, and 50% were of accept- 
able validity. About one-quarter of the studies reported implementation problems. 

Compared to students in the control groups, those participating in SEL universal 
programs demonstrated significantly enhanced social-emotional skills, attitudes, 
and positive social behavior, reduced conduct problems and emotional distress, and 
improved academic performance at post-intervention. The mean effect sizes for these 
outcomes ranged from 0.23 for reduced conduct problems and emotional distress 
and improved attitudes to 0.60 for enhanced social and emotional skills (see Table 2). 
Although the effect sizes for these outcomes were smaller at follow-up, they remained 
significant in five out of the six outcome categories. Only emotional distress was not 
significant at follow-up, and the mean effect for academic performance was direction- 
ally higher at follow-up (see Table 2). 

These outcomes are comparable to or exceed the benefits on similar outcomes 
found in eight other meta-analyses of psychosocial or educational interventions for 
school-aged youth (see Table 3). Moreover, when these effect sizes were translated 
into improvement indices that show percentile gains achieved by the average stu- 
dent in an intervention class compared to the average student in a control class, they 
ranged from a 9-10% improvement in positive attitudes and social behaviors, conduct 
problems, and emotional distress to an 11% gain in academic performance and a 23% 
gain in social-emotional skills. These improvement indices provide a better indica- 
tor of the practical value of improved outcomes than effect sizes alone (Kirk, 1996; 
Vacha-IIaase & Thompson, 2004). 

Despite these overall positive findings, not all universal interventions were equally 
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effective. Those that used four evidence-hased practices, indicated hy the acronym 
SAFE (Table 4), and/or those that did not encounter any of several implementation 
problems (e.g., failure to implement all program components as written or inadequate 
training for new teachers implementing a program) (Table 5), had more significant 
outcome effects and larger effect sizes than those that did not use all four practices 
and/or experienced implementation problems. Universal interventions that included 
all four of these evidence-based practices had significant mean effect sizes in all six 
outcome categories. Programs that did not meet the SAFE criteria had significant 
effects in only three outcome categories (attitudes towards self, school, and others; 
conduct problems; and academic performance). Even though the mean effects for 
these three outcomes were significant, they were smaller in magnitude than those of 
programs that met the SAFE criteria. 

When outcomes were analyzed by delivery format, significant outcomes in all six 
categories were achieved when a classroom-based intervention was implemented by 
the teacher (Table 6). These interventions usually consisted of a specific curriculum 
and set of instructional strategies. Similar classroom-based interventions imple- 
mented by researchers achieved significant outcomes in only two of the six categories 
- SEE skills and conduct problems. Multi-component programs that included both 
classroom instruction and a school-wide, parent, or community component achieved 
significant outcomes in only four of the six categories, perhaps due to the greater 
implementation challenges of such programs (Lipsey & Wilson, 2001). The results 
make clear that classroom teachers can effectively implement these programs. It is 
feasible for school staff to implement these programs (see Table 6). 

Indicated Review 

While many SEE programs are designed as universal interventions to address the 
needs of all children and youth both during school and in after-school settings, some 
programs focus on the needs of students who already show signs of social, emotional, 
behavioral, or learning problems. From a policy perspective, this is an important time 
to intervene: if this less-intensive type of programming can prevent students with pre- 
senting problems from developing full-blown diagnoses that require intensive mental 
health treatment, schools can save much money and time devoted to mental health 
services. 

Table 7 summarizes many of the characteristics of the 80 indicated programs 
included in this review. More than half (56%) of the reviewed reports appeared since 
1990, mostly in the form of published articles or books. Regarding methodological fea- 
tures, 80% of the indicated studies used a randomized design, and only 16% reported 
problems with attrition. Eighty-one percent used measures that met reliability stan- 
dards, and two-thirds of the measures met validity standards. 

Programs serving elementary- and middle-school students comprised 69% and 31%, 
respectively, of the reports reviewed, and over half of the programs were implemented 
in urban areas. Students participating in these programs most frequently displayed 
conduct problems (38%) such as aggression or bullying; followed by emotional distress 
(23%) such as anxiety or depression; and problems with peer relationships (10%). In 
the remainder of the programs, children presented either with more than one prob- 
lem each (e.g., depression and relationship problems in the same child), designated 
as “comorbid problems,” or they presented as participants in a single program with a 
mixture of different problems. 

School personnel identified children for participation in a program in 38% of the 
studies, while students self-identified or were identified by a peer in 18% and 9% of 
studies, respectively. More than half (59%) of the programs consisted of a single inter- 
vention component such as small-group problem-solving, in which programs taught 
students to become aware of bodily cues that indicate how they or others were feeling 
or strategies for coping with anxiety such as generating alternative solutions. Forty- 
one percent of programs included multiple components (e.g., both one-on-one and 
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group activities). Twenty-three percent of programs included training parents in how 
to reinforce what their children were learning at school (Table 7). Half of the indicat- 
ed programs used non-school personnel exclusively to deliver the intervention; 21% 
used school personnel; and 20% used a combination of both school and non-school 
personnel. Most interventions lasted less than six months, and 51% lasted less than 
three months. 

Significant mean effect sizes ranging from 0.38 for improved attitudes toward self, 
school, and others to 0.77 for improved social and emotional skills were achieved 
in all six outcome categories studied. Participants in these indicated SEL programs 
received significantly greater benefits across outcome categories than did participants 
in the control groups. Although the magnitude of these effects was generally lower at 
follow-up, they were still significant in five out of the six categories (all except aca- 
demic performance) (see Table 8). 

When program effects were calculated based on the presenting problems of partici- 
pants, students with a range of presenting problems showed greater improvements 
than control students (see Table 9). Mean effects ranged from 0.42 for studies that 
included group of children with assorted presenting problems to 0.92 for those includ- 
ing individual children with more than one (i.e., “comorbid”) identified presenting 
problem. Similarly, significant mean program effects were achieved for all groups 
when calculated by program deliverer - school staff, non-school staff, or a combina- 
tion of the two groups (Table 9). Similar to universal programs, school personnel can 
implement this type of programming effectively. While we have no data indicating 
why the effect size for combined program delivery was lower (0.26) than for programs 
with a single component, the greater coordination requirements of such delivery may 
have been a factor (Lipsey & Wilson, 2001). 

yVfter-school Review 

Table 10 summarizes characteristics of the after-school studies included in this 
review. These studies tended to be more recent even than those that appeared in the 
universal review: more than 70% appeared since 2000. An equal proportion of them 
were unpublished reports. More than half of the studies (56%) looked at programs 
serving elementary school students, and like those in the universal review, most of 
these were intended for general student audiences rather than for students already 
exhibiting problems. As in the school-based studies, more than one-third of the 
after-school studies did not report the race-ethnicity of participants, and 44% did not 
report on socio-economic background. IVhile these missing data did not allow us to 
determine differential program effects based on these factors, it is clear from the data 
available that after-school programs were effective with widely varying student popu- 
lations based on race and socio-economic status. 

The settings where programs were delivered were about equally divided between 
school grounds and the surrounding community. More than 56% of these programs 
lasted from six months to a year. In terms of content, a little more than half of the 
programs included no academic component, 58% used all four evidence-based (SAFE) 
practices, and 42% had parent involvement. With regard to methodological features, 
more than three-quarters did not use a randomized design. Two-thirds of the mea- 
sures were of acceptable reliability, and only 14% reported problems with attrition. 

Compared to students in control groups, participants in after-school SEL programs 
experienced significant mean effects in all five outcome categories analyzed, although 
one of these (emotional distress) was based on a very small sample size (Table 11). 
Other significant outcomes ranged from a 0.08 effect size for increased academic 
performance to 0.22 for attitudes toward self and others and positive social behaviors. 
The mean effect sizes were generally higher in the universal than after-school pro- 
grams. Of the 55 programs included in the after-school review that reported outcomes 
at post, 32 of them met all four criteria for using SAFE evidence-based practices, 
as described earlier (see Table 11). As in the school-based universal review, these 



14 



Collaborative for Academic, Social, and Emotional Learning 



December 2008 




programs achieved significantly better effects than those that didn’t meet the SAFE 
criteria. Those meeting these criteria were signihcant in all five outcome categories 
analyzed, ranging from 0.17 for improved academic performance to 0.41 for improved 
positive social behaviors. Those not meeting SAFE criteria had no significant effects 
across the five outcome categories. 

As in the review of universal programs, the mean effect sizes achieved in the 
after-school review were comparable to or greater than those achieved in eight other 
reviews of universal interventions for children and youth, although not all outcome 
categories were included in these other reviews (see Table 12). 
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Discussion 



The positive 
impact of these 
programs on 
academic outcomes 
was particularly 
noteworthy in 
light of the current 
educational policy 
environment in 
which schools are 
held accountable for 
raising student test 
scores. 



O ur findings across reviews of universal and indicated SEL programs con- 
ducted during the school day and of SEL programs conducted in after-school 
settings showed that these programs significantly impacted a wide range 
of outcomes across multiple domains in children both with and without identified 
emotional or behavioral problems. These programs achieved significant effects across 
all six of the outcome categories studied (five categories in the after-school review): 
improved SEL skills; attitudes toward self and others; positive social behaviors; re- 
duced conduct problems; emotional distress; and improved academic performance. 

In the universal and indicated reviews, program effects in most outcome categories 
remained significant at some follow-up point beyond post-intervention. Follow-up 
measurements in the after-school review were insufficient to determine if program 
effects persisted at follow-up. 

The positive impact of these programs on academic outcomes, including school 
grades and standardized achievement test scores, was particularly noteworthy in light 
of the current educational policy environment in which schools are held accountable 
for raising student test scores. Although some educators argue against implement- 
ing this type of holistic programming because it takes valuable time away from core 
academic material, our findings suggest that SEL programming not only does not 
detract from academic performance but actually increases students’ performance on 
standardized tests and grades. 

The effects of these SEL programs were equal to or exceeded those of other school- 
based prevention and after-school psychosocial programs on comparable student out- 
comes. In fact, when the practical value of SEL programs was demonstrated through 
conversion of program effects to improvement indices, they showed that the average 
student in an SEL intervention class gained 11 to 17 percentile points on academic 
test scores compared to the average student in a control class. 

The majority of studies reporting the racial-ethnic composition of the student bod- 
ies studied was diverse. We found that SEL program effects were achieved in student 
populations that were diverse racially-ethnically, socio-economically, and geographi- 
cally (i.e., urban, suburban, and rural). 

Moreover, our findings indicated that it is feasible for schools to implement these 
programs themselves. A common complaint about this type of holistic programming 
is that it cannot be sustained once the researchers leave the school because only re- 
searchers are capable of delivering it. But this is not the case with SEL programs. Not 
only can programs be delivered as effectively by school personnel as by researchers 
(or other non-school personnel), but in many cases in our reviews program imple- 
mentation by school personnel achieved greater impact than implementation by non- 
school experts. 

Our findings also indicated that including four evidence-based training practices 
(i.e.. Sequenced or coordinated instructional steps. Active learning methods, a Focus 
on skill instruction, and Explicit teaching of specific skills) significantly improved 
program outcomes. Although SAFE practices don’t capture all aspects of effective skill 
development, our findings indicated that they were effective in multiple outcome ar- 
eas and that programs without these procedures were not as effective. We also found 
that good implementation is crucial to positive outcomes, even though our data were 
not detailed enough for us to differentiate the impact of different types of implemen- 
tation problems on outcomes. The finding that multi-component programs were not 
as effective as single component programs may have been due to the fact that the 
former were less likely to have used SAFE practices and were more likely to have had 
implementation problems. 

SEL intervention programs for students exhibiting adjustment or learning prob- 
lems worked for a wide range of presenting problems, were effective when delivered 
by either school or non-school personnel, and had significant outcomes whether they 
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included only one or multiple program components. 

Although care was taken to include a representative and up-to-date sample of 
recent studies, and analyses of methodological variables were conducted to rule out 
plausible alternative explanations for findings, our research did have several limita- 
tions. First, it wasn’t possible to determine whether teaching certain skills or combi- 
nations of skills affected some outcomes more than others. This information would 
be helpful in designing programs to impact specific skills sets. Also, there are many 
program characteristics and evidence-based practices (beyond SAFE) associated with 
positive outcomes for youth that were not examined in this analysis. Second, because 
most studies measured outcomes at only one point in time, it was not possible to de- 
termine if certain skills mediated final outcomes by first contributing to intermediate 
or proximal outcomes. Knowing such mechanisms of change is also helpful in pro- 
gram design. Third, only 16% of the universal studies and less than one-third of the 
after-school studies collected data on academic achievement at post, and only 15% of 
universal studies assessed program impact at follow-up of at least six months dura- 
tion. As a result, conclusions about the persistence of SEE program outcomes should 
be made with caution. 

A fourth limitation was the small number of studies that collected demographic 
data on program participants. This made it impossible to determine the possible dif- 
ferential impact on student outcomes in any of the implementation contexts among 
different racial, ethnic, or cultural groups. However, we can say with confidence that 
SEE programs, especially those using evidence-based practices, benefit both children 
without identified social-emotional, behavioral, or learning problems and those who 
are beginning to show signs of such problems. Such programs should be recommend- 
ed as potentially successful options for promoting youth well-being and adjustment 
both during and after school hours. 

Future Research Directions 

This manuscript is the first to systematically document the impact of SEE program- 
ming within Universal, Indicated, and After-School samples. One important question 
for future research is to determine the extent to which coordinated programming ef- 
forts (e.g.. Universal plus Indicated or Universal plus After-school) produce more pow- 
erful effects than when programs are offered separately. In addition, although more 
research is needed to determine the relationship between academic performance and 
personal and social development, analyses done for this study suggest a synergistic ef- 
fect between these two developmental domains. Future research should also aspire to 
identify (a) what program characteristics contribute to which specific outcomes, (b) 
the differential benefits that various student groups derive from these programs and 
how these programs can be adapted to meet the needs of these groups, (c) the degree 
to which program effects persist over time, and (d) how to improve student participa- 
tion in these programs. 

Policy Implications 

The meta-analytic reviews of SEE program evaluation research on which we have 
focused here are part of a larger picture demonstrating the extent of current interest 
in SEE research, policy, and practice to promote school children’s social, emotional, 
and academic development. Neuroscience research, for example, has demonstrated 
that because of the plasticity of the brain, experience across the lifespan changes it. 
This finding suggests that school children’s participation in SEE programming will lay 
a strong neurocognitive foundation for their future learning, social functioning, and 
ability to emotionally self-regulate. In fact, SEE policymaking based on this research 
has already taken off in several states (e.g., Illinois, New York) and countries (e.g., 
Singapore, Great Britain, Spain). 

Illinois has been a leader in establishing SEE policies by approving legislation that 
includes SEE as part of the State’s learning standards and is now funding statewide 
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professional development for school teams involved in implementing schoolwide SEL. 
New York has also passed a similar law and is in the process of establishing guide- 
lines to promote social and emotional learning and development. In addition, several 
large districts - such as Anchorage, Alaska - are developing their own SEL standards, 
aligning their curricula with these standards, and implementing SEL programming 
throughout the district. Consistent with the findings of research cited here, Anchor- 
age has found that its SEL initiative has reduced problem behaviors among its stu- 
dents, improved their attitudes toward school, and increased their academic perfor- 
mance. 

Recent research also finds that principal leadership in supporting SEL program- 
ming enhances student benefits from SEL programming (Kam, Greenberg, & Walls, 
2003) and that professional development for administrators, teachers, student 
support staffs, and human service providers is critical to ensure the quality of SEL 
program implementation (Devaney, et al. 2006). 

Although there is still much to learn about how best to implement and support 
school-wide SEL programming, the current research base clearly demonstrates its val- 
ue in promoting the social, emotional, and academic development of school children. 




CASEL 



18 



Collaborative for Academic, Social, and Emotional Learning 



December 2008 




Table 1: Descriptive Characteristics of 180 Studies with Outcomes at Post in the Universal Review 





N 


% 


General Publication Features 


Date of report 


1955-1979 


15 


8 


1980-1989 


26 


14 


1990-1999 


73 


41 


2000-2007 


66 


37 


Source of report 


Published article/books 


142 


79 


Unpublished reports 


38 


21 


Methodological Features 


Randomization 


Yes 


80 


45 


No 


100 


55 


Reported problems with attrition 


Yes 


53 


29 


No 


127 


71 


Implementation 


Not reported on 


75 


42 


No significant problems reported 


62 


34 


Significant problems reported 


43 


24 


Use of reliable outcome measures^ 


Yes 


483 


76 


No 


154 


24 


Use of valid outcome measures^ 


Yes 


316 


50 


No 


321 


50 


Rater 


Child 


318 


50 


Parent 


26 


4 


Teacher 


130 


20 


Observer 


75 


12 


Peer 


15 


2 


School records 


67 


11 


Researcher 


3 


<1 


Unknown 


3 


<1 
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Table 1 cont. 





N 


% 


Participant Features 


Educational level of participants^ 


Elementary school (grades 1-5) 


116 


64 


Middle school (grade 6-8) 


64 


36 


Predominant racial or ethnic group 


Caucasian 


42 


23 


African-American 


17 


9 


Latino 


1 


<1 


Asian American 


1 


<1 


Native American 


2 


1 


Mixed"* 


64 


36 


Did not report 


53 


29 


Predominant socioeconomic status4 


Lower/working 


60 


33 


Middle/upper class 


23 


13 


Mixed"* 


50 


28 


Did not report 


47 


26 


Intervention Features 


Intervention format 


Classroom hy teacher 


101 


56 


Classroom hy research staff 


34 


19 


Multiple contexts 


45 


25 


SAFE criteria 


Curriculum rated as SAFE 


137 


76 


Curriculum not rated as SAFE 


16 


9 


Intervention had no curriculum 


27 


15 


Duration 


9 weeks or less 


24 


13 


10 weeks to 18 weeks (one semester) 


51 


29 


19 to 36 weeks (one school year) 


56 


31 


1 to 2 school years 


22 


12 


More than 2 school years 


27 


15 
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Table 1 cont. 





N 


% 


Mean number of sessions (based on 1 71 studies) 


45 




Median number of sessions 


25 




Locale of intervention 


United States 


158 


88 


Outside the United States 


22 


12 


General area of school 


Urban 


84 


47 


Suburban 


30 


17 


Rural 


25 


14 


Combination of areas 


27 


15 


Did not report 


14 


7 


Note: The percentages do not always add to 100% due to missing data. 






^ The reliability of an outcome measure was satisfactory if its alpha coefficient was ^.70, or evaluat- 
ing inter-judge agreement for coding or rating variables was a. 70 (for kappa, >.60). This is coded at 
the outcome level; therefore most studies have more than one outcome. 

^ The validity of an outcome measure was satisfactory if evidence of construct, predictive, or dis- 
criminant validity was provided by the authors. 

^ Elementary students were 5 to 10 years old and middle school students were 11 to 13 years old. 

Predominant means at least 75% of the sample involved this category; whereas mixed means that 
at least 20% of the sample was drawn from a2 of the listed categories. 
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Table 2: Student Outeonies Obtained at Post and FoUow-up in 180 Studies in the Universal Review 



Outeome 

Category 


Outcome Effects 


At post 


At follow-up 


Mean effect 
size 


Confidence 

interval 


Number of 
studies 


Mean effect 
size 


Confidence 

interval 


Number of 
studies 


SEL skills 


0.60* 


0.49-0.71 


56 


0.36* 


0.20-0.52 


6’ 


Attitudes 
toward self 
and others 


0.23* 


0.15-0.31 


87 


0.12* 


0.03-.21 


14 


Positive so- 
cial behavior 


0.24* 


0.15-0.32 


84 


0.17* 


0.07-0.28 


11 


Conduct 

problems 


0.23* 


0.15-0.31 


99 


0.15* 


0.08-0.23 


17 


Emotional 

distress 


0.23* 


0.10-0.35 


39 


0.13 


0.00-0.26 


6’ 


Academic 

performance 


0.28* 


0.14-.41 


29 


0.32* 


0.15-0.48 


6’ 



’^Denotes mean effect is significantly different from zero at the . 05 level 
f Because of the small sample, caution is advised in interpreting these results. 



Table 3: Comparison of the Magnitude of Student Change at Post in 
Review with Outcomes in Previous Meta-analytic Reviews 


180 Studies in the Universal 




Outcome Effect 


Outcome Category 


Mean effect size in current 
review 


Mean effect size in reviews coir- 
ducted by other researchers 


SEL skills 


0.60* 


0.40" 


Attitudes toward self and others 


0.23* 


0.09b 


Positive social behavior 


0.24* 


0.39" 0.37" 0.15‘> 


Conduct problems 


0.23* 


0.26" 0.28" 0.2U 0.17" 0.30‘ 


Emotional distress 


0.23* 


0.2U0.24"0.17« 


Academic performance 


0.28* 


0.29'’ O.lU 0.30' 0.24*’ 


'^’Denotes mean effect is significantly different from zero at the 0.05 level 

Note: Results from other meta-analyses are from outcome categories most comparable to those in the 
current review and values are drawn from weighted random effects analyses whenever possible, 
a = Losel & Beelmann, 2003 b = Haney & Durlak, 1998 c = Wilson & Lipsey, 2007 
d = DuBois et al, 2002 e = Wilson et al., 2001 f = Durlak & Wells, 1997 
g = Horowitz & Graber, 2007 h = Hill, Bloom, Black, & Lipsey, 2007 
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Table 4: Student Outeonies Obtained at Post in 180 Studies in the Universal Review in Programs Us- 
ing and Not Using Evidence-based (SAFE)® Training Practices 



Outcome 

Category 


Outcome Effects 


Programs used SAFE practices 


Programs did not use SAFE practices 


Mean effect 
size 


Confidence 

interval 


Number of 
studies 


Mean effect 
size 


Confidence 

interval 


Number of 
studies 


SEE skills 


0.69* 


0.51-0.87 


54 


-0.3 


-0.96-0.90 


2 ' 


Attitudes 
toward self 
and others 


0.25* 


0.19-0.30 


66 


0.14* 


0.03-0.24 


21 


Positive so- 
cial behavior 


0.28* 


0.18-0.39 


71 


0.02 


-0.20-0.25 


13 


Conduct 

problems 


0.25* 


0.18-0.32 


77 


0.16* 


0.03-0.30 


22 


Emotional 

distress 


0.27* 


0.10-0.44 


24 


0.17 


-0.52-0.39 


15 


Academic 

performance 


0.29* 


0.17-.41 


20 


0.23* 


0.06-0.40 


91 



Mean effect is significantly different from zero at the 0.05 level 
§ Sequenced, Active, Focused, and Explicit 

f Because of the small sample, caution is advised in interpreting these results. 
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Table 5: Student Outeonies Obtained at Post in 180 Stndies in the Universal Review by Reported 
Program Implementation Problems 



Out- 

come 

Cat- 

egory 


Outcome Effect 


Implementation 
not mentioned 


No implementation 
problems reported 


Implementation 
problems reported 


Mean 

effect 

size 


Confi- 

dence 

interval 


No. of 
studies 


Mean 

effect 

size 


Confi- 

dence 

interval 


No. of 
studies 


Mean 

effect 

size 


Confi- 

dence 

interval 


No. of 
studies 


SEL 

skills 


0.55* 


0.28- 

0.83 


21 


0.96* 


0.69- 

1.23 


22 


0.35* 


0.01- 

0.72 


13 


Atti- 
tudes 
toward 
self and 
others 


0.15* 


0.07- 

0.23 


37 


0.32* 


0.23- 

0.41 


29 


0.19* 


0.10- 

0.29 


21 


Positive 

social 

behavior 


0.32* 


0.16- 

0.47 


32 


0.31* 


0.16- 

0.45 


34 


0.01 


-0.18- 

0.20 


18 


Conduct 

prob- 

lems 


0.23* 


0.12- 

0.34 


32 


0.28* 


0.18- 

0.39 


38 


0.16* 


0.05- 

0.27 


29 


Emo- 

tional 

distress 


0.21* 


0.02- 

0.40 


20 


0.35* 


0.09- 

0.61 


10 


0.14 


-0.14- 

0.42 


91 


Aca- 

demic 

perfor- 

mance 


0.31* 


0.15- 

0.48 


91 


0.34* 


0.19- 

0.48 


12 


0.15 


-0.02- 

0.31 


8' 



’"Denotes mean effect is significantly different from zero at the . 05 level 
f Because of the small sample, caution is advised in interpreting these results. 
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Table 6: Student Outcomes Obtained at Post in 180 Studies in the Universal Review by Program 
Delivery Format 



Out- 

come 

Cat- 

egory 


Outcome Effects by Program Delivery Format 


Classroom-based 
intervention by teacher 


Classroom-based 
intervention by researcher 


Multi-component with parent 
or school-wide component 
in addition to classroom 
intervention 


Mean 

effect 

size 


Confi- 

dence 

interval 


No. of 
studies 


Mean 

effect 

size 


Confi- 

dence 

interval 


No. of 
studies 


Mean 

effect 

size 


Confi- 

dence 

interval 


No. of 
studies 


SEL 

skills 


0.68* 


0.46- 

0.90 


34 


0.84* 


0.51- 

1.17 


16 


0.13 


-0.37- 

0.64 


6’ 


Atti- 
tudes 
toward 
self and 
others 


0.24* 


0.17- 

0.31 


49 


0.14 


0.00- 

0.27 


16 


0.22* 


0.13- 

0.32 


22 


Positive 

social 

behavior 


0.27* 


0.15- 

0.38 


58 


0.21 


-0.08- 

0.49 


10 


0.19 


-0.02- 

0.39 


16 


Conduct 

prob- 

lems 


0.21* 


0.11- 

0.30 


49 


0.17* 


0.01- 

0.33 


14 


0.27* 


0.18- 

0.37 


36 


Emo- 

tional 

distress 


0.23* 


0.01- 

0.45 


15 


0.17 


-0.11- 

0.45 


10 


0.27* 


0.05- 

0.49 


14 


Aca- 

demic 

perfor- 

mance 


0.43* 


0.22- 

0.63 


71 


0.01 


-0.38- 

0.41 


2’ 


0.25* 


0.14- 

0.36 


20 



* Denotes mean effect is significantly different from zero at the .05 level 
f Because of the small sample, caution is advised in interpreting these results. 
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Table 7 : Descriptive Characteristics of 80 School-Based Studies with Outcomes at Post 
in the Indicated Review 





N 


% 


General Publication Features 


Date of report 


1970-1979 


7 


9 


1980-1989 


27 


34 


1990-1999 


28 


35 


2000-2007 


18 


22 


Source of report 


Published article/books 


68 


85 


Unpublished reports 


12 


15 


Methodological Features 


Randomization 


Yes 


64 


80 


No 


16 


20 


Reported problems with attrition 


Yes 


13 


16 


No 


67 


84 


Use of reliable outcome measures^ 


Yes 


176 


81 


No 


41 


19 


Use of valid outcome measures'^ 


Yes 


149 


69 


No 


68 


31 


Rater 


Child 


83 


38 


Parent 


14 


7 


Teacher 


48 


22 


Observer 


24 


11 


Peer 


20 


9 


School records 


28 


13 
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Table 7 cont. 





N 


% 


Participant Features 


Educational level of participants 


Elementary school (grades K-5 or mean age 5-10) 


55 


69 


Middle school (grades 6-8 or mean age 11-14) 


25 


31 


Locale of intervention 


United States 


68 


85 


Outside the United States 


12 


15 


General area of school 


Urban 


44 


55 


Suhurhan 


8 


10 


Rural 


14 


18 


Comhination of areas 


5 


6 


Did not report 


9 


11 


Primary presenting problem 


Conduct problems 


30 


38 


Emotional distress 


18 


23 


Peer relations 


8 


10 


Comorbid problems (i.e., each child presents with more than one problem) 


3 


4 


Individual children present with a variety of problems 


21 


25 


Predominant racial or ethnic group^ 


Caucasian 


12 


15 


African-American 


10 


13 


Hispanic 


2 


2 


Asian 


1 


1 


Mixed^ 


24 


30 


Did not report 


31 


39 


Predominant socioeconomic status^ 


Lower/working class 


18 


23 


Middle/upper class 


7 


9 


Mixed 


12 


15 


Did not report 


43 


53 



The Positive Impact of Social and Emotional Learning for Kindergarten to 8th-Grade Students 



27 



CASEL 





Table 7 cont. 





N 


% 


Intervention Features 


How children were identified 


Referral 


16 


20 


Single measure 


41 


51 


Multiple measures 


23 


29 


Who identified children 






School personnel 


30 


38 


Self 


15 


18 


Peer 


7 


9 


Parent 


2 


2 


Multiple persons 


26 


33 


Intervention components 


Single component intervention 


47 


59 


Multi-component Intervention, including parent training 


33 


41 


Agent that primarily delivered intervention 


School personnel 


17 


21 


Peer leader 


1 


1 


Non-school personnel 


40 


50 


Combination 


16 


20 


Did not provide adequate information 


6 


8 


Duration 


Less than 3 months 


41 


51 


3 to 6 months 


18 


23 


6 months to 1 year 


8 


10 


1 to 2 years 


11 


14 


More than 2 years 


2 


2 


Implementation 


No problems noted 


42 


53 


Problems noted 


11 


13 


Not monitored 


27 


34 


Note: The percentages do not always add to 100% due to missing data. 






^ The reliability of an outcome measure was satisfactory if its alpha coefficient was ^.70, or evaluat- 
ing inter-judge agreement for coding or rating variables was a. 70 (for kappa, >.60). This is coded at 
the outcome level; therefore most studies have more than one outcome. 

* The validity of an outcome measure was satisfactory if evidence of construct, predictive, or dis- 
criminant validity was provided by the authors. 

^ Predominant means at least 75% of the sample involved this category; whereas mixed means that 
at least 20% of the sample was drawn from a2 of the listed categories. 
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Table 8: Student Outeonies Obtained at Post and FoUow-up in 80 Studies in the Indieated Review 



Outcome 

Category 


Outcome Effects 


At post 


At follow-up 


Mean effect 
size 


Confidence 

interval 


Number of 
studies 


Mean effect 
size 


Confidence 

interval 


Number of 
studies 


SEL skills 


0.77* 


0.46-1.07 


11 


0.46* 


0.12-0.79 


6’ 


Attitudes 
toward self 
and others 


0.38* 


0.19-0.56 


29 


0.30* 


0.07-0.54 


11 


Positive so- 
cial behavior 


0.50* 


0.34-0.66 


38 


0.42* 


0.17-0.66 


11 


Conduct 

problems 


0.47* 


0.34-0.60 


53 


0.30* 


0.14-0.47 


21 


Emotional 

distress 


0.50* 


0.34-0.67 


35 


0.58* 


0.37-0.80 


13 


Academic 

performance 


0.43* 


0.17-0.69 


12 


0.67 


0.40-1.74 


1’ 



’^Denotes mean effect is significantly different from zero at the .05 level 
f Because of the small sample size, caution is suggested in interpreting these results. 



Table 9: Student Outcomes Obtained at Post in 80 Studies in the Indicated Review by Presenting 
Problem, Program Deliverer, and Implementation Monitoring Status 


Moderating Variable 


Outcome Effects 


Mean effect 
size 


Confidence 

interval 


Number of 
studies 


Presenting problem(s) of child in study 


Conduct problems 


0.44* 


0.29-0.58 


30 


Emotional distress 


0.54* 


0.33-0.76 


18 


Peer relations 


0.89* 


0.53-1.26 


8’ 


Each child presents with more than one problem 
(comorbid) 


0.92* 


0.36-1.47 


3’ 


Individual children present with a variety of problems 


0.42* 


0.24-0.60 


21 


Program Deliverer 


School personnel 


0.54* 


0.41-0.69 


40 


Non-school personnel 


0.59* 


0.49-0.79 


17 


Combination of school and non-school 


0.26* 


0.07-0.46 


16 


Program Implementation Status 


Monitored without problems 


0.45* 


0.32-0.57 


42 


Monitored with problems 


0.30* 


0.06-0.54 


11 


Not monitored 


0.71* 


0.53-0.88 


27 


’"Denotes mean effect is significantly different from zero at the .05 level 
f Because of the small sample size, caution is suggested when interpreting these results. 
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Table 10: Descriptive Characteristics of 57 Studies in the After-School Review 





N 


% 


Publication Features 


Date of report 


1983-1990 


2 


4 


1991-2000 


15 


26 


2001-2007 


40 


70 


Source of report 


Published article 


17 


30 


Unpublished report 


40 


70 


Methodological Features 


Randomization 


Yes 


13 


23 


No 


44 


77 


Use of reliable outcome measures^ 


Yes 


245 


67 


No 


119 


33 


Problems with attrition 


Yes 


8 


14 


No 


48 


84 


Not reported and incalculable 


1 


2 


Characteristics of participants 


Mean educational level 


Elementary school (K-5) 


32 


56 


Middle school (6-8) 


25 


44 


Presenting Problems 


Some presenting problem 


4 


7 


No presenting problem 


53 


93 


Predominant racial or ethnic group^° 


African-American 


11 


19 


Latino 


8 


14 


Asian/Pacific Islander 


4 


7 


American Indian 


1 


2 


Mixed® 


12 


21 


Did not report 


21 


37 


Predominant socioeconomic status^” 


Lower/working 


24 


42 


Mixed income® 


8 


14 


Did not report 


25 


44 




CASEL 



30 



Collaborative for Academic, Social, and Emotional Learning 



December 2008 





Table 10 cont. 





N 


% 


Program Features 


Duration 


s 25 weeks 


12 


22 


26-52 weeks 


31 


56 


> 52 weeks 


12 


22 


Setting 


On school grounds 


27 


47 


In community 


28 


49 


Did not report 


2 


4 


Academic components 


Tutoring/homework assistance 


26 


46 


No academic component 


31 


54 


Use of evidence-based training Procedures (SAFE practices) 


Yes 


33 


58 


No 


24 


42 


Some parent involvement 


Yes 


24 


42 


No 


33 


60 


Note. The percentages do not always add to 100% due to missing data. 






® The reliability of an outcome measure was satisfactory if its alpha coefficient was ^.70, or evaluat- 
ing inter-judge agreement for coding or rating variables was a. 70 (for kappa, >.60). This is coded at 
the outcome level; therefore most studies have more than one outcome. 

Predominant means at least 75% of the sample involved this category; whereas mixed means that 
at least 20% of the sample was drawn from a2 of the listed categories. 
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Table 11: Student Outeomes Obtained at Post in 55 After-Sehool Studies of SAFE® 
and Other Programs 



Out- 

come 

Cat- 

egory 


Outeome Effects 


All after school programs 


SAFE programs 


Other (non-SAFE) programs 


Mean 

effect 

size 


Confi- 

dence 

interval 


No. of 
studies 


Mean 

effect 

size 


Confi- 

dence 

interval 


No. of 
studies 


Mean 

effect 

size 


Confi- 

dence 

interval 


No. of 
studies 


Atti- 
tudes 
toward 
self and 
others 


0.22* 


0.11- 

0.20 


39 


0.32* 


0.20- 

0.44 


24 


0.04 


0.12- 

0.19 


15 


Positive 

social 

behavior 


0.22* 


0.11- 

0.34 


33 


0.41* 


0.23- 

0.58 


18 


0.00 


-0.08- 

0.09 


15 


Conduct 

prob- 

lems 


0.17* 


0.10- 

0.25 


51 


0.35* 


0.22- 

0.47 


27 


-0.03 


-0.08- 

0.03 


24 


Emo- 

tional 

distress 


0.91* 


0.63- 

1.19 


5’ 


0.90* 


0.59- 

1.20 


5’ 


- 


- 


- 


Aca- 

demic 

perfor- 

mance 


0.08* 


0.02- 

0.15 


31 


0.17* 


0.08- 

0.26 


13 


-0.03- 

0.06 


0.03- 

0.06 


18 



* Denotes mean effect is significantly different from zero at the .05 level 

§ SAFE program used four evidence based skill training practices — Sequenced instruction, Active 
instructional methods, Focus on teaching social-emotional skills in at least one program component, 
and Explicit instruction on one or more social-emotional skills 
f Because of the small sample, caution is advised in interpreting these results. 



Table 12: Comparison of the Magnitude of Student Change Obtained at Post in 55 Studies in the 
After-School Review with Outcomes in Previous Meta-analytic Reviews 


Outcome Category 


Outcome Effect 


Mean effect size in current 
review 


Mean effect size in reviews con- 
ducted by other researchers 


Attitudes toward self and others 


0.22* 


O.IO’* 

(based on self-perception only) 


Positive social behavior 


0.24* 


0.15^ 0.39" 


Conduct problems 


0.17* 


0.21^ 0.27", O.OO-^ 


Emotional distress 


0.91* 


0.17", 0.30‘ 


Academic performance 


0.08* 


0.11'’, 0.30', 0.24® (based on 
achievement tests only) 


'"Denotes mean effect is significantly different from zero at the 0.05 level 
a = Haney & Durlak, 1998 b = DuBois et al., 2002 c = Losel & Beelman, 2003 

d = Wilson et al., 2003 e = Wilson et al., 2001 f = Durlak & Wells, 1997 

g = Hill, Bloom, Black & Lipsey, 2007 
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